Skip to content

Automatically purge studies from the triage portal that are >30 days old#1313

Open
jamesqo wants to merge 2 commits into
masterfrom
purge-old-triage-studies
Open

Automatically purge studies from the triage portal that are >30 days old#1313
jamesqo wants to merge 2 commits into
masterfrom
purge-old-triage-studies

Conversation

@jamesqo
Copy link
Copy Markdown
Contributor

@jamesqo jamesqo commented Mar 27, 2026

Adds a new DAG with the following flow:

  • Get current db production color
  • Locate the connection credentials from the properties file sitting on pipelines3 (should this be stored as an Airflow connection instead?)
  • Connect to database and find all studies from the cancer_study table with an import_date of >30 days
  • Connect to Google Sheets and mark of all studies with a matching STABLE_ID with an r in the triage-portal column

cc @sheridancbio

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant